# High-performance Inference

Kimi-Dev-72B is a large-scale language model developed by moonshotai. It is optimized through GGUF quantization and offers multiple quantization versions to meet different hardware requirements.

Legion-V2.1-LLaMa-70B-Elarablated-v0.8-hf is a quantized version based on LLaMa-70B, optimized using llama.cpp, offering multiple quantization options to accommodate different hardware requirements.

AceReason-Nemotron-7B is a large language model based on the Nemotron architecture with 7B parameters, offering multiple quantized versions to accommodate different hardware requirements.

This is the Llamacpp imatrix quantized version of the NVIDIA OpenCodeReasoning-Nemotron-14B model, suitable for code reasoning tasks.

This is a distilled model based on Llama-70B, converted to MLX format via mlx-lm and quantized to 4 bits.

This is a multi-model fusion result based on the Qwen2.5-14B architecture, utilizing the Model Stock fusion method, combining 22 different 14B-parameter scale models from various sources.

An instruction-tuned variant based on Qwen2.5 Bakeneko 32B, enhanced with Chat Vector and ORPO optimization for improved instruction-following capabilities, excelling in Japanese MT-Bench.

The GGUF format version of Llama 3 70B Instruct, providing a more efficient local running experience

ECE-TW3-JRGL-V5 is a new model obtained by merging the MoMo-72B-lora-1.8.7-DPO and alpaca-dragon-72b-v1 models through mergekit, integrating the advantages of multiple models.

Yi-34B-Chat is a bilingual-optimized large language model developed by 01.AI, excelling in language understanding, commonsense reasoning, and reading comprehension, supporting both Chinese and English interactions.